📊 AI Benchmarks - CWhiting · Scour

You don't need all the LLM benchmarks 🏆LLM Benchmarking

alex.smola.org·6d·Hacker News

Independent benchmarks for self-hosted AI 📊AI Performance Profiling

fitmyllm.com·2h

Can LLMs Generate Enterprise-Quality Code? 🏆LLM Benchmarking

startuphub.ai·11h

The future will be millions agents running task everyday? 📋AGENTS.md

github.com·1d·Hacker News

Resolution Diagnostics for Paired LLM Evaluation 📊Model Evals

Alibaba’s new AI model scores higher than OpenAI, Google rivals in coding ranking 🇨🇳Chinese AI

·4d·r/SCMPauto

intent-bench/intent-bench: Intent fulfillment benchmark for agentic AI engineering 💻Coding Agents

github.com·3d·Hacker News

Low Rank for Rank: Uncertainty-Aware Task-Specific LLM Ranking under Sparse Pairwise Comparisons 🏆LLM Benchmarking

Latent Performance Profiling of Large Language Models ⚡LLM Optimization

WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation 🌍World Models

AVBench: Human-Aligned and Automated Evaluation Benchmark for Audio-Video Generative Models 👁️Perceptual Coding

FormInv: A Measurement Protocol for Semantic Invariance in Mathematical Reasoning Benchmarks 🏆LLM Benchmarking

Pre-Registering the Detectable Effect: A Paired-MDE Budget for 4-bit Quantization Benchmarks, with a Pilot Audit ⚡LLM Optimization

MarginGate: Sparse Margin-Triggered Verification for Batch-Invariant LLM Inference ⚡LLM Optimization

Quantifying the Impact of Translation Errors on Multilingual LLM Evaluation 🏆LLM Benchmarking

Benchmarks are Not Enough: RAMP for Runtime Assessing of Agentic Models in Production Systems 🧠Context Engineering

Aryabhata 2: Scaling Reinforcement Learning for Advanced STEM Reasoning 🤝AI-Assisted Coding

FinVerBench: Benchmark Validity and Calibration in Large Language Model Financial Statement Verification ✅Document Verification

Qiskit QuantumKatas: Adapting Microsoft's Quantum Computing exercises for LLM evaluation ⚛️Quantum Computing

TCP-MCP: Landscape-Guided Co-Evolution of Prompts and Communication Topologies for Multi-Agent Systems 🤝Agent Systems

Log in to enable infinite scrolling